System, method, and computer readable medium for defining an allowable range of image processing

ABSTRACT

According to the present invention, the album including user&#39;s favorite pictures as main features can be easily provided. The system includes; a image capturing section which captures an image; an image capturing time measuring section which measures the time after setting the image capturing section ready to capture the image and while the user continues to operate the image capturing section to capture the image in each image capturing operation of the image capturing section; a ranking calculating section which ranks the image based on the image capturing time calculated by the image capturing time measuring section; and an output controlling section which displays or prints out the image ranked more highly by the ranking calculating section.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Divisional of copending application Ser. No.11/896,876 filed on Sep. 6, 2007, and for which priority is claimedunder 35 U.S.C. §120. application Ser. No. 11/896,876 is Continuation ofPCT International Application No. PCT/JP2006/304848 filed on Mar. 7,2006. The entire contents of each of the above-identified applicationsare hereby incorporated by reference.

TECHNICAL FIELD

The invention relates to an image output system, an image capturingapparatus, an output apparatus, an image output method, an imagecapturing method, an output method, and a computer readable medium.Especially, the invention relates to an image output system, an imagecapturing apparatus, an output apparatus, an image output method, animage capturing method, an output method, each of which is required tooutput an image, and a computer readable medium storing thereon aprogram used for the image capturing apparatus and the output apparatus.

The present application claims priority from a Japanese PatentApplications Nos. JP2005-062882 filed in JP on Mar. 7, 2005 andJP2006-19540 filed in JP on Jan. 27, 2006, the contents of which areincorporated herein by reference if applicable.

BACKGROUND ART

A conventional art, for example, Japanese patent application publicationNo. 1998-126731, discloses that the album in which photo images takenwhile traveling are laid out in a map there with the indication where totake the photos. In the album, the map is arrayed in the middle of thescreen, and the photo images arranged around the map are connected bylines to the photo-taken spots on the map by means of the locationinformation related with the photo images and the tag information suchas the photo-taken time so that the relation of the map and the imagesis clearly shown.

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention

The album made according to the Japanese patent application publicationNo. 1998-126731 cannot always display the user's favorite photo imagesin prominent positions therein. The user is likely to hope the photoimage which was taken carefully and thoroughly are used in the albumcover, or displayed prominently. The user is likely to hope to make thealbum easily without troublesome procedures such as selecting andediting images.

To solve the above problem the invention has the purpose of providingthe image output system, the image capturing apparatus, the outputapparatus, the image output method, the image capturing method, theoutput method, and the programs. The present purpose can be achieved bythe combination of the elements described in the independent claims inthe range of what we claim. The dependent claims add useful embodimentsof the present invention.

Means for Solving the Problems

The first embodiment of the present invention includes; an imagecapturing section which captures an image; a image capturing timemeasuring section which measures the time after setting the imagecapturing section ready to capture the image and while the usercontinues to operate the image capturing section to capture the image ineach image capturing operation of the image capturing section; a rankingcalculating section which ranks the image based on the image capturingtime calculated by the image capturing time measuring section; and anoutput controlling section which displays or prints out the image rankedmore highly by the ranking calculating section.

The image capturing time measuring section may measure the time fromsetting the image capturing section ready for capturing an image of anobject to finishing capturing the image of the object. The imagecapturing time measuring section may measure the time after setting theimage capturing section ready for capturing the image of the object andwhile the user continues the image capturing section to capture theimage of the object.

The output controlling section may display or print out the image whichis ranked more highly by the ranking calculating section. The outputcontrolling section may display the image which is ranked more highly bythe ranking calculating section for longer time.

The first embodiment of the present invention may further includes; aauxiliary image capturing section in which plurality of auxiliary imagescaptured sequentially at the timing before the image capturing sectioncaptures the image; a composition change amount detecting section inwhich the amount of change in composition in the plurality of theauxiliary images captured by the auxiliary image capturing section; andan operation controlling section which decides whether the user operatesthe image capturing section to capture the image based on the amount ofchange in composition detected by said composition change amountdetecting section. If the operation controlling section detects nouser's operation while the image capturing section is ready to capturean image of an object and captures the image, the image capturing timemeasuring section may measure the time from which the operationcontrolling section decides there is no image capturing operation towhich the image capturing section captures the image.

The composition change amount detecting section detects the identicalarea of the image in sequentially captured auxiliary images by theauxiliary image capturing section. The operation controlling section maydecide no image capturing operation by the user when the area detectedby composition change amount detecting section is smaller area than thepredetermined.

The first embodiment of the present invention further includes; acriteria storing section in which criteria for detecting there is nouser's image capturing operation as relating to the type and amount ofchange in composition. The composition change amount detecting sectiondetects the amount of change in composition of plurality of auxiliaryimages captured by the auxiliary image capturing section for every typeof change stored in criteria storing section. The operation controllingsection may detect no image capturing operation by the user when thecomposition change amount detecting section detects the type of changeand the amount of change in composition match the criteria stored in thecriteria storing section.

The image output method according to the second embodiment of thepresent invention includes; an image capturing procedure in which animage is captured; an image capturing time measuring procedure in whichthe time required for each image capturing operation in the imagecapturing procedure is measured; a ranking procedure in which the imagecaptured in the image capturing procedure is ranked based on the imagecapturing time measured in the image capturing time measuring procedure;and an output controlling procedure in which more highly ranked image inthe ranking procedure is output preferentially.

The image capturing apparatus according to the third embodiment of thepresent invention includes; an image capturing section which captures animage; an image capturing time measuring section which measures the timerequired for each image capturing operation the image capturing sectionto capture the image; a ranking calculating section which ranks theimages captured by the image capturing section based on the imagecapturing time measured by the image capturing time measuring section;and a ranking data storing section which stores the ranking data givenby the ranking calculating section as relating to the images captured bythe image capturing section.

The ranking calculating section may more highly rank the image which isrequired longer time to be captured which is measured by the imagecapturing time measuring section.

The image capturing method according to the fourth embodiment of thepresent invention includes; an image capturing procedure in which animage is captured; an image capturing time measuring procedure in whichthe time required for each image capturing operation in the imagecapturing procedure is measured; a ranking procedure in which the imagecaptured in the image capturing procedure is ranked based on the timerequired for capturing the image measured in the image capturing timemeasuring procedure; and a ranking data storing procedure in which theranking data of the image ranked in the ranking procedure as relating tothe image captured in the image capturing procedure.

The computer readable medium storing thereon a program for an imagecapturing apparatus which captures an image according to the fifthembodiment of the present invention functions the image capturingapparatus which includes; an image capturing section which captures animage; a image capturing time measuring section which measures the timerequired for each image capturing operation of the image capturingsection; a ranking calculating section which ranks the image captured bythe image capturing section based on the time measured by the imagecapturing time measuring section; and a ranking data storing sectionwhich stores the ranking data of the image ranked by the rankingcalculating section as relating to the image captured by the imagecapturing section.

The output device according to the sixth embodiment of the presentinvention includes; an image storing section which stores the imagecaptured by the image capturing apparatus; an image capturing timestoring section which records the time required for the image capturingapparatus to capture each image, which is stored in the image storingsection; a ranking calculating section which ranks the image stored inthe image storing section based on the image capturing time stored inthe image capturing time storing section; and an output controllingsection which controls the image more highly ranked by the rankingcalculating section is output preferentially.

The output method according to the seventh embodiment of the presentembodiment includes; an image storing procedure in which the imagecaptured by the image capturing apparatus is stored; an image capturingtime storing procedure in which the time required for the imagecapturing apparatus to capture each image stored in the image storingsection; a ranking procedure in which the image stored in the imagestoring procedure is ranked based on the time stored in the imagecapturing time storing procedure; and an output controlling procedure inwhich the image more highly ranked in the ranking procedure is outputpreferentially.

The computer readable medium storing thereon a program for an outputdevice which outputs an image according to the eighth embodiment of thepresent invention functions the output device which includes; an imagestoring section which stores the image captured by the image capturingapparatus; an image capturing time storing section which stores the timerequired for the image capturing apparatus to capture each image storedin the image storing section; a ranking calculating section which ranksthe image stored in the image storing section based on the time storedin the image capturing time storing section; and an output controllingsection which outputs the image more highly ranked by the rankingcalculating section preferentially.

The image output system according to the ninth embodiment of the presentinvention includes; an image capturing section which captures an image;an photographic parameters acquiring section which acquires the changein photographic parameters changed by the user's operation whilecapturing the image by the image capturing section as relating to theimage captured by the image capturing section; an image processingdetermining section which defines the allowable range of processing theimage captured by the image capturing section to be output; and an imageprocessing plan presenting section which displays the allowable range ofimage processing defined by the image processing determining section tothe user.

The image output system according to the ninth embodiment of the presentinvention further includes; an image processing section which providesthe image captured by the image capturing section with the imageprocessing operation within the range allowed by the image processingcontrolling section; and an output section which outputs the imageprocessed by the image processing section.

The photographic parameters acquiring section may obtain the change inphotographic parameters changed by the user after the image capturingsection is ready to capture the image of the object and until itfinishes capturing it.

The photographic parameters acquiring section may obtain the filed angleand the amount of change in filed angle which are resulted from theuser's operation until said image capturing section captures the imageas relating to the image captured by said image capturing section. Theimage processing determining section may define the allowable range oftrimming when the image captured by the image capturing section istrimmed and output. The image processing plan presenting section maydisplay the allowable trimming range defined by the image processingdetermining section to the user.

The image output method according to the tenth embodiment of the presentinvention includes; an image capturing procedure in which an image iscaptured; an photographic parameters acquiring procedure in which thechange in photographic parameters changed by the user's operation untilthe image is captured are acquired as relating to the image captured inthe image capturing procedure; and an image processing determiningprocedure in which the allowable range of processing the image capturedin said image capturing procedure to be output is defined based on thechange in photographic parameters acquired in said photographicparameters acquiring procedure, and the defined allowable range of imageprocessing is displayed to the user.

The image capturing apparatus according to the eleventh embodiment ofthe present invention includes; an image capturing section whichcaptures an image; an photographic parameters acquiring section whichacquires the change in photographic parameters changed by the user'soperation while capturing the image by said image capturing section asrelating to the image captured by said image capturing section; an imageprocessing determining section which defines the allowable range ofprocessing the image captured by said image capturing section to beoutput based on the change in photographic parameters acquired by saidphotographic parameters acquiring section; and an image processing planstoring section which stores the allowable range of image processingdefined by the image processing determining section as relating to theimage captured by the image capturing section.

The image capturing method of the twelfth embodiment of the presentinvention includes; an image capturing procedure in which an image iscaptured; an photographic parameters acquiring procedure in which thechange in photographic parameters changed by the user's operation whilecapturing the image by said image capturing section is acquired asrelating to the image captured by said image capturing procedure; animage processing determining procedure in which the allowable range ofimage processing is defined when the image captured by the imagecapturing section is output based on the change in photographicparameters acquired in said photographic parameters acquiring procedure;and an image processing plan storing procedure in which the allowablerange of image processing defined by the image processing determiningsection is stored as relating to the image captured by the imagecapturing section.

The computer readable medium storing thereon a program for an imagecapturing apparatus which captures an image of the thirteenth embodimentof the present invention functions the image capturing apparatus whichincludes; an image capturing section which captures an image; anphotographic parameters acquiring section which acquires the change inphotographic parameters changed by the user's operation until the imagecapturing section captures the image as relating to the image capturedby the image capturing section; an image processing determining sectionwhich defines the allowable range of processing the image captured bythe image capturing section to be output based on the change inphotographic parameters acquired by the photographic parametersacquiring section; and an image processing plan storing section whichstores the allowable range of image processing defined by the imageprocessing determining section as relating to the image captured by theimage capturing section.

The output device of the fourteenth includes; an image storing sectionwhich stores an image captured by an image capturing apparatus; aphotographic parameters acquiring section which acquires the change inphotographic parameters changed by the user's operation until the imagecapturing section captures the image as relating to the image capturedby the image capturing section; an image processing determining sectionwhich defines the allowable range of image processing when the imagecaptured by the image capturing section is output based on the change inphotographic parameters stored in said photographic parameters storingsection; and an image processing plan presenting section in which theallowable range of image processing defined by the image processingdetermining section is displayed to the user.

The output method of the fifteenth embodiment of the present inventionincludes; an image storing procedure in which the image captured by theimage capturing apparatus is stored; a photographic parameters storingprocedure in which the change in photographic parameters changed by theuser's operation until the image is captured by said image capturingapparatus as relating to the image stored in said image storingprocedure; an image processing determining procedure in which theallowable range of processing the image stored in the image storingprocedure when the image stored in image storing procedure is output isdefined based on the change in photographic parameters stored in thephotographic parameters storing procedure; and a image processing plandisplaying procedure in which the allowable range of image processingdefined in the image processing determining procedure is displayed tothe user.

The computer readable medium storing thereon a program for an outputdevice which outputs an captured image of the sixteenth embodiment ofthe present invention functions the output device which includes; animage storing section which stores an image captured by an imagecapturing apparatus; an photographic parameters storing section whichstores the change in photographic parameters changed by the user'soperation until the image capturing section captures the image asrelating to the image captured by the image capturing section; an imageprocessing determining section which defines the allowable range ofprocessing the image stored in the image storing section to be outputbased on the change in photographic parameters stored in thephotographic parameters storing section; and an image processing planpresenting section which displays the allowable range of imageprocessing defined by the image processing determining section.

The above summary of the present invention doesn't include all of thenecessary features. The sub-combinations of these features may beinventions.

Effect of the Invention

According to the invention, the album in which user's favorite picturesare arranged distinctly is provided.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an example of how the image output system 190 is used.

FIG. 2 is a block diagram showing the structure of the image outputsystem 190.

FIG. 3 is a flow chart showing the process of calculating the timerequired to capture an image.

FIG. 4 is a table including criteria stored in the criteria storingsection 228.

FIG. 5 shows how the counter operates when the operation controllingsection 222 calculates the time required for image capturing based onthe changed area.

FIG. 6 is a block diagram showing the structure of the image outputsystem 690 of the second embodiment.

FIG. 7 is a flow chart showing the process of image processing of theoutput device 640 according to the instruction of the user 180.

FIG. 8 is a table including the parameters used for the image processingdetermining section 674 to define the allowable range of imageprocessing.

FIG. 9 is a block diagram showing the structure of the hardwarecomponents relating to the image capturing apparatus 100, the outputdevice 140, the image capturing apparatus 600, and the output device640.

DESCRIPTION OF THE NUMBERS

-   -   100 image capturing apparatus    -   140 output device    -   180 user    -   190 image output system    -   202 image capturing section    -   204 image storing section    -   206 image capturing time measuring section    -   208 image capturing time storing section    -   210 ranking calculating section    -   212 ranking data storing section    -   222 operation controlling section    -   224 composition change amount detecting section    -   226 auxiliary image capturing section    -   228 criteria storing section    -   230 identical area extracting section    -   232 object extracting section    -   234 Brightness histogram detecting section    -   236 color histogram detecting section    -   238 texture analysis section    -   244 image storing section    -   248 image capturing time storing section    -   250 ranking calculating section    -   254 output controlling section    -   256 output section    -   600 image capturing apparatus    -   602 image capturing section    -   604 image storing section    -   630 photographic parameters acquiring section    -   632 photographic parameters storing section    -   634 image processing determining section    -   636 image processing plan storing section    -   640 output device    -   644 image storing section    -   656 output section    -   672 photographic parameters storing section    -   674 image processing determining section    -   676 image processing plan storing section    -   678 image processing section    -   680 image processing plan presenting section    -   690 image output system

BEST MODE FOR CARRYING OUT THE INVENTION

The following description explains the present invention withembodiments. The embodiments described below do not limit the inventionclaimed herein. All of the combinations described on the embodiments arenot essential to the solutions of the present invention.

FIG. 1 shows an example of how to use the image output system 190relating to an embodiment of the present invention. The image outputsystem 190 includes an image capturing apparatus 100 and an outputdevice 140. The image capturing apparatus 100 captures an image andrecords the time required for capturing the image. For example, theimage capturing apparatus 100 records the time from turning on the powerto finishing capturing the image. The output device 140 receives theimage captured by the image capturing apparatus 100 and the timerequired for capturing the image. These data is transferred from theimage capturing apparatus 100 to the output device 140 via acommunication line 150 such as the Internet or various types of recordmedia. The output device 140 displays the image which is required longertime to be captured in the center of the screen. For example, the outputdevice 140 outputs and arranges the images required longer time to becaptured in the album cover, in the center and major part of the page,and in the whole background of the page. Such images are treateddistinctly.

The image capturing apparatus 100 records how photographic parametersare changed by the user until capturing the image. The image capturingapparatus 100, for example, records the amount of change in field anglein the operation the user 180. The output device 140 can trim thecaptured image significantly changed in filed angle than predetermined.In this case, the output device 140 controls the trimming operation bythe user 180 so that the size of the trimmed image is larger than thepredetermined size. Such control can prevent from over-trimming theimage which the user deliberately captured with a wide angle. The imageoutput system 190 can prevent from processing the image in the manner inwhich the user 180 doesn't intend while capturing the image.

The image capturing apparatus 100 may be a digital still camera, acamera-equipped cell phone, or a personal digital assistant (PDA) with acamera. The image capturing apparatus 100 may display the image takenlonger time to be captured in the center of the screen in large size.The output device 140 may be a personal computer, a digital album, ahigh-definition television, or other display devices which can displayplurality of images at the same time on a screen. The output device 140may be a printer or other devices which can print and output an image.

The image capturing apparatus 100 may store the time required to capturethe image in the directory which is included in a server connecting thecommunication line 150 and allocated for the user 180 as relating to theimage capturing apparatus 100. The output device 140 may receive theimage and the time required for capturing the image which are stored inthe directory of the server which is allocated for the user 180.

According to the image output system 190, the album which can, forexample, arrange the image which is taken carefully and cautiously asmain features can be provided. The user 180 can enjoy seeing such album.

FIG. 2 shows a block diagram of the image output system 190. The imagecapturing apparatus 100 includes an image capturing section 202, animage storing section 204, an image capturing time measuring section206, an image capturing time storing section 208, a ranking calculatingsection 210, a ranking data storing section 212, an operationcontrolling section 222, a composition change amount detecting section224, a auxiliary image capturing section 226, a criteria storing section228, an identical area extracting section 230, an object extractingsection 232, a Brightness histogram detecting section 234, a colorhistogram detecting section 236, and a texture analysis section 238. Theoutput device 140 includes an image storing section 244, an imagecapturing time storing section 248, a ranking calculating section 250,output controlling section 254, and output section 256.

The image capturing section 202 captures an image. The image storingsection 204 stores the image captured by the image capturing section202. The image storing section 204 stores the image captured by theimage capturing section 202 as relating to the image identification usedfor distinguish each image among the plurality of images.

The image capturing time measuring section 206 measures the timerequired for capturing the image by the image capturing section 202 ineach image capturing operation of the image capturing section 202. Theimage capturing time measuring section 206 measures the time requiredfor capturing the image from setting the image capturing section 202ready to capture the image of an object to making the image capturingsection 202 finish capturing the image of the object. More specifically,the image capturing time measuring section 206 starts to count when theimage capturing section 202 is set to be ready to capture the image ofthe object, and keeps to count while the image capturing section 202 isoperated to capture the image of the object by the user 180 to calculatethe time required for capturing the image. The time measured by theimage capturing time measuring section 206 includes the time for focusadjustment, shutter speed adjustment, and other preparation forcapturing the image of the object, if these adjustments or preparationsare done within a predetermined time interval. The image capturing timemeasured by the image capturing time measuring section 206 may alsoinclude the time from setting the image capturing section 202 ready tocapture the image of the object until the operation controlling section222 detects the user 180 releases the shutter button. The imagecapturing time may be the information which indicates the timing ofsetting the image capturing section 202 ready to capture the image andthe timing of capturing the image.

The image capturing time storing section 208 stores the time measured bythe image capturing time measuring section 206 as relating to each imagestoring section 204. The image capturing time storing section 208 storesthe time measured by the image capturing time measuring section 206 asrelating to the corresponding image ID.

The ranking calculating section 210 ranks the image based on the imagecapturing time measured by the image capturing time measuring section206. The ranking calculating section 210 more highly ranks the imagewhich the image capturing time measuring section 206 measures longertime for capturing. The ranking calculating section 210 more highlyranks the image stored in the image capturing time storing section andrequired longer time to be captured.

The ranking data storing section 212 stores the ranking data given bythe ranking calculating section 210 as relating to the image captured bythe image capturing section 202. The ranking data storing section 212stores the ranking data given by the ranking calculating section 210 asrelating to the corresponding image ID.

The image capturing time storing section 208 may store the timecalculated by the image capturing time measuring section 206 and attachit as the tag information to the image stored in the image storingsection 204. The ranking data storing section 212 may store the rankingdata calculated by the ranking calculating section 210 and attaches itas the tag information to the image stored in the image storing section204.

The image storing section 244 stores the image for the image captured bythe image capturing apparatus 100. The image storing section 244 storesthe data for the image and image ID received from the image storingsection 204.

The image capturing time storing section 248 stores the time required tocapture the image with the image capturing apparatus 100 as relating toeach image stored in the image storing section 244. The image capturingtime storing section 248 stores the image ID received from the imagecapturing time storing section 208 and the time required for capturingthe image. The image capturing time storing section 248 may include thetime required for capturing the image, which is extracted from the taginformation of the image stored in the image storing section 244.

The ranking calculating section 250 ranks the image stored in the imagestoring section 244 based on the time required for capturing the image,which is stored in the image capturing time storing section 248. Theranking calculating section 250 more highly ranks the image stored inthe image storing section 244, which is required longer time to becaptured. The time required for capturing the image is stored in theimage capturing time storing section 248.

The output controlling section 254 preferentially outputs the image morehighly ranked by the ranking calculating section 250. The outputcontrolling section 254 may preferentially output the image havinghigher ranking data stored in the ranking data storing section 212. Theoutput controlling section 254 may also preferentially output the imagehaving higher ranking data extracted from the tag information of theimage stored in the image storing section 244. The output section 256outputs plurality of the images under the instruction from the outputcontrolling section 254. The output section 256 may be a display devicesuch as a liquid crystal display device which displays an image, or aprinting device which prints out and output an image.

The output controlling section 254 displays or prints out the imagewhich has higher ranking data given by the ranking calculating section250. When the output controlling section 254 displays or prints outseveral images in different regions on the output section 256, the morehighly ranked image among the images output by the output section 256may be displayed or printed out in the center of the screen and inlarger size, or in the foreground. The output controlling section 254may display or print out the more highly ranked image among the imagesoutput by output section 256 in upper position on the screen in largerseize. The output controlling section 254 may select the more highlyranked image to display or print out preferentially. The outputcontrolling section 254 may preferentially select the more highly rankedimage to display or print out distinctly with decorations such as aframe or special effects. The output controlling section 254 maypreferentially select and trim the more highly ranked image to displayor print out distinctly.

The output controlling section 254 may display longer the more highlyranked image. When the output controlling section 254 displays pluralityof images one by one on the output section 256, the more highly rankedimage may be displayed longer. When the output controlling section 254displays plurality of images one by one on the output section 256, themore highly ranked image may be displayed preferentially.

The auxiliary image capturing section 226 obtains plurality of auxiliaryimages which are captured at the timing before the image captured by theimage capturing section 202. The auxiliary images may, for example, becaptured after the image capturing section 202 is ready to capture andbefore the image capturing section 202 captures the image by theinstruction of the user 180. The image capturing apparatus 100 displayssuch plurality of auxiliary images on a display device such as a monitorto allow the user 180, for example, to define a captured area, decide afocused object, adjust exposure before capturing the image.

The composition change amount detecting section 224 detects how much thecomposition changes between the plurality of the auxiliary imagesobtained by the auxiliary image capturing section 226. For example, thecomposition change amount detecting section 224 calculate the identicalarea in sequential auxiliary images obtained by the auxiliary imagecapturing section 226. The operation controlling section 222 then judgewhether the user 180 operates the image capturing section 202 to capturethe image of an object based on the amount of change in compositiondetected by the composition change amount detecting section 224. Whenthe area detected by the composition change amount detecting section 224is smaller than predetermined, the operation controlling section 222decides no image capturing operation by the user 180.

The identical area extracting section 230 finds out the identical areain the sequential auxiliary images obtained by the auxiliary imagecapturing section 226. The composition change amount detecting section224 calculates the identical area in the sequential auxiliary imagesobtained by the auxiliary image capturing section 226, which is detectedby the identical area extracting section 230. The composition changeamount detecting section 224 detects the ratio of the difference betweenthe said identical area and the area of the auxiliary image to the areaof the auxiliary image and defines the ratio as the amount of change incomposition. The object extracting section 232 extracts each objectincluded in the auxiliary images obtained by the auxiliary imagecapturing section 226. The composition change amount detecting section224 counts the number of the identical objects extracted from theauxiliary images by the object extracting section 232, and calculate theamount of change in composition based on the number of such objects. TheBrightness histogram detecting section 234 makes brightness histogramsfrom the plurality of auxiliary images obtained by the auxiliary imagecapturing section 226. The composition change amount detecting section224 may calculate the amount of change in composition based on theamount of change in the brightness histograms of the plurality ofauxiliary images made by the Brightness histogram detecting section 234.The color histogram detecting section 236 makes color histograms fromthe plurality of auxiliary images obtained by the auxiliary imagecapturing section 226. The composition change amount detecting section224 may calculate the amount of change in composition based on theamount of change in the color histograms of the plurality of auxiliaryimages made by the color histogram detecting section 236. The textureanalysis section 238 analyses textures from the plurality of theauxiliary images obtained by the auxiliary image capturing section 226.The composition change amount detecting section 224 may calculate theamount of change in composition based on the amount of change in thetexture of the plurality of auxiliary images made by the textureanalysis section 238.

When the operation controlling section 222 decides the user 180 doesn'tdo image capturing operation after the image capturing section 202 isset to be ready to capture the image of the object and until the imagecapturing section 202 captures the image of the object, the imagecapturing time measuring section 206 measure the time since theoperation controlling section 222 decides no image capturing operationby the user 180 and until the image capturing section 202 captures theimage to define it as the time required for capturing the image. Theuser 180 may keep the image capturing apparatus 100 on and dangle itfrom the neck for a while. If the image capturing time measuring section206 adds such time to calculate, the time required for capturing theimage includes the time in which the user 180 doesn't intend to capturethe image. In such case, if the image capturing apparatus 100 detectsthe substantial change in composition between the auxiliary images, itdecides the user 180 doesn't intend to capture the image and doesn'tinclude the time in the image capturing time. The image capturingapparatus 100 can calculate the appropriate time required for capturingthe image.

The criteria storing section 228 stores the criteria which relate to thetypes of change showing how the composition change and the amount ofchange in composition and are provided to judge the user 180 doesn'toperate to capture the image. The composition change amount detectingsection 224 calculates the amount of change in composition between theplurality of auxiliary images obtained by the auxiliary image capturingsection 226 as checking and identifying each type of change stored inthe criteria storing section 228. When the criteria stored in thecriteria storing section 228 applies to the type and amount of change incomposition detected by composition change amount detecting section 224,the operation controlling section 222 decides that the user 180 doesn'toperate the image capturing section 202 to capture the image.

The criteria storing section 228 stores the reference value. As to theidentical area the reference value is, for example, 70%. If theidentical area is smaller than the reference value, the operationcontrolling section 222 decide no image capturing operation by the user180. As described above, the operation controlling section 222 can judgewhether the user 180 intend to operate the image capturing section 202to capture the image of the object based on the amount of change incomposition detected by composition change amount detecting section 224.The image capturing apparatus 100 can appropriately define the time inwhich the user 180 intend to capture the image as the time required forcapturing the image by defining.

The above image output system 190 can provide the album automaticallyarranging the images which the user 180 adjusts some photographicparameters and waits the right moment to capture in the cover or in thecenter of a page and in large size. The user 180, therefore, can easilyget the album in which the favorite images are arranged as mainfeatures.

FIG. 3 is the flow chart of calculating the time required for capturingthe image. The image capturing apparatus 100 decides whether the user180 operate to capture the image (S402). Image capturing operation bythe user 180 may includes adjusting some photographic parameters such asspeed and focus, pressing down the shutter button, turning on theswitch, or other operation relating to movement for capturing the imagewith the image capturing apparatus 100.

At the stage of S402, if the image capturing apparatus 100 decides theuser 180 operate to capture the image (S402: YES), the image capturingtime measuring section 206 make a counter start to count the timerequired for capturing the image. The operation controlling section 222judges whether the amount of change in composition in auxiliary imagesis smaller than the reference value (S405). At the stage of S405, if theoperation controlling section 222 judges the amount of change incomposition in auxiliary images is smaller than the reference value(S405: YES), the image capturing apparatus 100 judges whether the imagecapturing operation is done in the predetermined time period after theprevious image capturing operation or after the counter starting tocount (S406). At the stage of 406, if the image capturing operation isdone in the predetermined time period (S406: YES), the image capturingapparatus 100 judges whether the shutter button is pressed (S408).

At the stage of 408, if the shutter button is pressed (S408: YES), theimage capturing section 202 captures the image (S410). The imagecapturing time measuring section 206 reads the value displayed in thecounter to define the time required for capturing the image at the stageof S410 (S412). The ranking calculating section 210 then ranks the imagebased on the image capturing time defined at the stage of S412. Theimage storing section 204, the image capturing time storing section 208,and the ranking data storing section 212 store the image captured at thestage of S410, the image capturing time defined at the stage of 412, andthe ranking data given at the stage of 414 respectively (S416) The imagecapturing time measuring section 206 resets the counter to display zero(S418), the image capturing apparatus 100 finishes the operation.

At the stage of S402, if the user doesn't operate to capture the image(S402: NO), the image capturing apparatus 10 repeats the S402 procedure.At the stage of S405, if the operation controlling section 222 decidesthe amount of change in composition is larger than the reference value(S405: NO), or at the stage of S406, if there is no image capturingoperation in the predetermined time period, the image capturing timemeasuring section 206 resets the counter to display zero (S420), theprocedure is returned to the stage of S402.

As described above, the image capturing time measuring section 206always resets if there is no image capturing operation in thepredetermined time period, if the user 180 presses down the shutterbutton after long interval without image capturing operation, the idleperiod in which the user 180 doesn't operate to capture the image isn'tincluded in the image capturing time. When the user 180 to adjust somephotographic parameters carefully and thoroughly, the image capturingtime measuring section 206 can includes the adjusting time in the imagecapturing time. The image capturing time measuring section 206 makes thecounter continue to count the image capturing time if the amount ofchange in composition in the auxiliary images is smaller than thereference value. The image capturing time measuring section 206 canappropriately measure the image capturing time after the user 180determines the composition of objects to set in the captured area of theimage capturing apparatus 100 and until the shutter button is presseddown. The image capturing time measuring section 206, therefore,appropriately measure the image capturing time in which the user 180continuously operates the image capturing section 202 to capture theimage of the object.

FIG. 4 is a part of the table showing the parameters stored in thecriteria storing section 228. The criteria storing section 228 storesthe reference values used for judging whether the user 180 operates tocapture the image. The reference value is 30% when the image area istreated the type of change. When the number of the object is treated asthe type of change, the criteria storing section 228 also stores theamount of change in object number of 33% as a reference value used forjudging whether the user 180 operate to capture the image. When thebrightness histogram is treated as the type of change, the criteriastoring section 228 also stores the amount of change in brightnesshistogram of 20% as a reference value used for judging whether the user180 operate to capture the image. When the color histogram is the typeof change, the criteria storing section 228 also stores the amount ofchange in color histogram of 20% as a reference value used for judgingwhether the user 180 operate to capture the image. When the texture is atype of change, the criteria storing section 228 also stores the amountof change in texture of 25% as a reference value used for judgingwhether the user 180 operate to capture the image. The amount of changein texture may be calculated based on the changes in camera angle oredge amount. The amount of changes in brightness and color histograms isdescribed below with examples. In the above description, the criteriastoring section 228 stores criteria relating the type of change and theamount of change, for example. The criteria storing section 228 alsostores other criteria as well as the amount of change. For example, whenthe texture is treated as the type of change, the criteria storingsection 228 can store the criteria relating to the change in textureused for judgment whether the user 180 operate to capture the image.

FIG. 5 shows the performance of the counter calculating the timerequired for capturing the image based on the image area changingbetween sequential auxiliary images, hereinafter the changing imagearea.

At the time of t500, the user 180 turns on the image capturing apparatus100 and the counter starts to count. The counter resets at the timing atwhich the changing image area detected by composition change amountdetecting section 224 becomes 300 or more of the whole area of theauxiliary image, for example at the points of t501 and t503. The counterrestarts at the timing at which the changing image area detected bycomposition change amount detecting section 224 becomes under the 30% ofthe whole area of the auxiliary image, for example at the points of 502and t504. If the shutter button of the image capturing apparatus ispressed down by the user 180 at the point of t505 the image capturingtime measuring section 206 calculates the image capturing time from thetime of restarting the counter at the point of t504 to the point oft505.

Now described is how the composition change amount detecting section 224works when calculating the changing image area in two sequentialauxiliary images. The identical area extracting section 230 calculatesthe amount of difference, or the density of the amount of difference, inthe target area A for calculating the amount of change in composition inthe auxiliary images based on the difference signals detected when theauxiliary images are overlapped and relatively slid away in variousmanners. The identical area extracting section 230 calculates, forexample, the difference signals per pixel at the point where the amountof difference is the smallest in the target area A, and detects thepixels which have the difference signals which are smaller than thereference value. The region detected by the identical area extractingsection 230 consists of such pixels. The composition change amountdetecting section 224 calculates the rest pixels without the pixelsdetected by the identical area extracting section 230 to define theindex of the area of the changed image region. The composition changeamount detecting section 224 may, off course, sum up the all areas ofthe pixels detected by the identical area extracting section 230 todefine the area of the changed image region. If the value calculated bydividing the area of the changed image region by the whole area theoperation controlling section 222, or the sum of the identical areas inthe auxiliary images is below the reference value of 30% stored in thecriteria storing section 228, the operation controlling section 222decides the user 180 continues image capturing operation, and makes thecounter keep on counting. If the value is the reference value of 30% ormore, the operation controlling section 222 decides the user doesn'toperate to capture the image, and resets the counter.

The following is described how the composition change amount detectingsection 224 operates when it counts the number of the objects which arechanged between the two sequential auxiliary images. The objectextracting section 232 extracts the outlines of the objects from thetarget area A in the auxiliary images by, for example, an edgeextraction method. The composition change amount detecting section 224calculates how much the outlines of the objects extracted from bothauxiliary images by the object extracting section 232 match each otherby a pattern matching method. The composition change amount detectingsection 224 calculates the number of the objects which has smalleridentical area than the predetermined. The number of the objects isdivided by whole number of the objects contained in the auxiliaryimages, or the average of the number of the objects contained in theplurality of the auxiliary images. When the resulted value is below thereference value of 33% stored in the criteria storing section 228, theoperation controlling section 222 decides the user 180 operates tocapture the image, and makes the counter keep on counting. When theresulted value is 33% or more, the operation controlling section 222decides the user 180 doesn't operate to capture the image, and resetsthe counter.

The following is described that the composition change amount detectingsection 224 detects the amount of change in brightness histogram in thetwo sequential auxiliary images and defines it as the amount of changein composition. The composition change amount detecting section 224picks up the plurality of pixels in the target area A where the amountof the change in composition is calculated, and detects the brightnessV.sub.ai of the pixel i in the first auxiliary image and the brightnessV.sub.bi of the pixel i in the second auxiliary image. Here, subscript“i” stands for one or more certain pixels. The composition change amountdetecting section 224 divides the smaller brightness value betweenV.sub.ai and V.sub.bi is divided by the other larger one to calculatethe value f.sub.vi for each pixel. The composition change amountdetecting section 224 divides the sum of the f.sub.vi values of thepixels i in the target area A where the amount of change in thebrightness histogram is calculated by the number of the pixels includedin the target area A, and defines the resulted value as the identicallevel F of the brightness histogram of the first and second auxiliaryimages. The composition change amount detecting section 224, forexample, subtracts F from 1 (1−F) to calculate the amount of change inbrightness histogram. The composition change amount detecting section224, therefore, can adequately calculate the amount of change incomposition including the change in appearance of the object between theauxiliary images.

The composition change amount detecting section 224 may also calculatethe amount of change in appearance of the brightness histogram. TheBrightness histogram detecting section 234 detects the brightness andthe number of the pixels in the target area A of the first and secondauxiliary images respectively and makes the first and second histogramswith the brightness and the number of the pixels for horizontal andvertical axes respectively. The composition change amount detectingsection 224 calculates the area which isn't identical in the twobrightness histograms. The composition change amount detecting section224 finds and calculates the minimum area which isn't identical in thetwo brightness histograms by sliding the second brightness histogramlaterally to maximize the identical area in the two brightnesshistograms. The composition change amount detecting section 224 dividesthe minimum area by the area of the first brightness histogram to definethe amount of change in brightness histogram. When the appearances ofthe first and second brightness histograms are identical, thecomposition change amount detecting section 224, therefore, doesn'tdetect the amount of the change in brightness histogram. Detecting theappearance change in brightness histograms can prevent from wronglydetecting a larger amount of change in composition when the user 180only changes aperture size.

The following is described that the composition change amount detectingsection 224 detects the amount of change in color histograms in the twosequential auxiliary images and defined it as the amount of change incomposition. The color histogram detecting section 236 divides each axisof the RGB space into Q to make the color histogram with axes of typicalcolors of Q.sup.3 from the target area A. When the numbers of pixelscorresponding to a color j calculated from each target area A in thefirst and second auxiliary images are defined as H.sub.i and M.sub.jrespectively, the composition change amount detecting section 224provides the smaller number of pixels g.sub.j between H.sub.j andM.sub.j. The composition change amount detecting section 224 divides thesum of the number of the pixels g.sub.j relating to the color j by thenumber of the pixels included in the target area A to define theresulted value as the matching level of color histogram. The compositionchange amount detecting section 224, for example, subtracts G from 1(1−G) to define the resulted value as the amount of change in colorhistogram. The color histogram tends not to be affected by the change incolor of the object. This can prevent from wrongly detecting a largeramount of change in composition if the appearance of the object ischanged in the auxiliary images because, for example, the object moves.

As described above, the composition change amount detecting section 224calculates the amount of change in brightness histogram by detecting thechange in appearance of the brightness histogram. This can be applied tocolor histogram, too. The composition change amount detecting section224 can calculate the amount of change in color histogram by detectingthe change in appearance of color histogram. The composition changeamount detecting section 224 may define the maximum value or the averagevalue in each histogram of red, blue and green as the amount of changein color histogram.

The following is described how the composition change amount detectingsection 224 detects the amount of change in texture in the twosequential auxiliary images to define it as the amount of change incomposition. The texture analysis section 238 calculates thecorrelativeness and edge amount in the target area A of the first andsecond auxiliary images. The composition change amount detecting section224 calculates the amount of change in texture based on thecorrelativeness and the edge amount calculated by the texture analysissection 238. For example, when the normalized correlation value in thetarget area A of the first and second auxiliary images is expressed byR, the texture analysis section 238 subtracts R from 1 (1−R) to definethe resulted value as the amount of change in texture. The textureanalysis section 238 also may detect the texture types of the targetarea A in the first and second auxiliary images. The texture analysissection 238 may decide a directional property of texture by the edgeextracted in target area A. The texture analysis section 238 stores theinformation about plurality of texture types relating to the vectorquantities of edge. The texture analysis section 238, therefore, selectsthe texture type which matches each vector quantity of the edgeextracted from the target area A among the texture types stored therein.The composition change amount detecting section 224 may detect thechange in texture type which is detected by the texture analysis section238 from the target area A of the first and second auxiliary images.

In those ways the Brightness histogram detecting section 234, the colorhistogram detecting section 236, and the texture analysis section 238detect the brightness histogram, the color histogram, and the textureand related parameters such as texture type respectively. The abovedescribed target area A may consist of the pixels sampled from theauxiliary images based on the predetermined density and distribution.The Brightness histogram detecting section 234, the color histogramdetecting section 236, and the texture analysis section 238 detect eachparameter from the sampling data which is obtained by sampling thepixels included in the image in the predetermined density anddistribution. It is preferable that the Brightness histogram detectingsection 234, the color histogram detecting section 236, and the textureanalysis section 238 detect each parameter by sampling the target area Awith the frequency which is lower than the predetermined. When the user180 continues to adjust focus and the image capturing section 202captures the auxiliary images of the same object, the amount of changein composition using with the parameter obtained by sampling with higherfrequency tends to be larger than using with the parameter obtained bysampling with lower frequency. The Brightness histogram detectingsection 234, the color histogram detecting section 236 and the textureanalysis section 238 detect each parameter by sampling with thefrequency which is lower than predetermined so that the amount of changein composition can prevent from being unintendedly detected in largeduring focus adjustment by the user 180. The image capturing timemeasuring section 206 can appropriately include the time required foradjusting focus by the user 180 in the image capturing time.

The identical area extracting section 230, the object extracting section232, the Brightness histogram detecting section 234, the color histogramdetecting section 236, and the texture analysis section 238 may definethe target area A from the identical region of the first and secondauxiliary images based on the zoom value at which the image is capturedby the image capturing section 202 If the zoom value C.sub.2 at whichthe second auxiliary image is captured is larger than the zoom valueC.sub.1 at which the first auxiliary image is captured, the identicalarea extracting section 230, the object extracting section 232, theBrightness histogram detecting section 234, the color histogramdetecting section 236, and the texture analysis section 238 specify thetarget region which is commonly captured in the first and the secondauxiliary images based on the zoom values C.sub.1 and C.sub.2. The 30,the object extracting section 232, the Brightness histogram detectingsection 234, the color histogram detecting section 236, and the textureanalysis section 238 make the target region in the second auxiliaryimage small to the size to be captured with the zoom value C.sub.1 onthe basis of the zoom values C.sub.1 and C.sub.2. The 30, the objectextracting section 232, the Brightness histogram detecting section 234,the color histogram detecting section 236, and the texture analysissection 238 detect the identical region, the object, the brightnesshistogram, the color histogram, and the texture respectively from thediminished target region and the first auxiliary image. In such way, thecomposition change amount detecting section 224 can appropriately detectthe amount of change in composition by compensating the change in imagesize resulted from the zooming operation by the user 180. The imagecapturing time measuring section 206 can appropriately include thezooming operation by the user 180 who want to capture the image withbest framing in the image capturing time.

The criteria storing section 228 can also store various parameters aswell as the changed image area, the changed number of objects, thechanged brightness histogram, the changed color histogram, and thechanged texture type. The operation controlling section 222 canappropriately judge whether the user 180 keep to capture the image ornot by comparing the plurality of the auxiliary images. As describedabove, whether the user 180 operates to capture the image is judged bythe operation controlling section 222 based on the changed the imagearea. In other words, the operation controlling section 222 can decidewhether the user 180 operates to capture the image by detecting the areaof identical region.

According to the image output system 190, the album which isautomatically arranged the images captured carefully and thoroughly bythe user 180 with adjusting parameters in the cover or in the center ofpage in larger size is provided to the user 180. The user 180,therefore, can easily get the album in which the favorite images arelaid out in prime places. The user 180, therefore, can enjoy seeing thealbum.

FIG. 6 is a block diagram showing the image output system 690 of thesecond embodiment. The image output system 690 has the purpose ofproviding an image output system which records the operation to adjustparameters by the user 180, and plans to process the image to be outputbased on the parameter recorded. The image output system 690 includes animage capturing apparatus 600 and an output device 640. The imagecapturing apparatus 600 includes an image capturing section 602, theimage storing section 604, the photographic parameters acquiring section630, the photographic parameters storing section 632, the imageprocessing determining section 634, and the image processing planstoring section 636. The output device 640 includes, the image storingsection 644, the photographic parameters storing section 672, the imageprocessing determining section 674, the image processing plan storingsection 676, the image processing section 678, the image processing planpresenting section 680, and an output section 656. The image outputsystem 690 can incorporate the functions incorporated in the outputsystem 190 of the first embodiment. For example, the image output system690 can record the photographic parameters operated during the imagecapturing time is counted by the image output system 190. The imageoutput system 690 can decide how the output image is made distinctivebased on the amount of operation of photographic parameters recorded.

The image capturing section 602 captures an image. The image storingsection 604 stores the image captured by the image capturing section602.

The photographic parameters acquiring section 630 obtains the data ofhow the photographic parameters are changed by the operations of theuser 180 until capturing the image as relating to the image captured bythe image capturing section 602. The photographic parameters acquiringsection 630 obtains the parameters changed by the user after setting theimage capturing section 602 ready for capturing an image of an object tofinishing to capture it.

The photographic parameters storing section 632 stores the data of howthe graphic parameters are changed by the operations of the user whilethe image capturing apparatus 600 captures the image as relating to theimage stored in the image storing section 604. The photographicparameters storing section 632 stores the data of the change inphotographic parameters obtained by the photographic parametersacquiring section 630 as relating to the image captured by the imagecapturing section 602.

The image processing determining section 634 defines the allowable rangefor processing the image to be output which is captured by the imagecapturing section 602 based on the change in photographic parametersobtained by photographic parameters acquiring section 630. The imageprocessing plan storing section 636 stores the data of the allowablerange for image processing defined by the image processing determiningsection 674 relating the image captured by the image capturing section602.

The photographic parameters acquiring section 630 obtains the data ofthe field angle and the change in field angle while the image capturingsection 602 captures the image by the operations of the user 180 asrelating to the image captured by the image capturing section 602. Theimage processing determining section 634 defines the allowable range fortrimming the image to be output which is captured by the image capturingsection 602 based on the data of the field angle and the change in fieldangle obtained by the photographic parameters acquiring section 630. Thephotographic parameters acquiring section 630 stores the data of theallowable range for trimming defined by the image processing determiningsection 674 as relating to the image captured by the image capturingsection 602.

The image storing section 644 stores the image captured by the imagecapturing apparatus 600. The image storing section 644 receives theimage stored in the image storing section 604. The photographicparameters storing section 672 stores the data of the change inphotographic parameters while the image capturing apparatus 600 capturesthe image by the operations of the user 180 as relating the image storedin the image storing section 604. The photographic parameters storingsection 672 stores the data of the change in the parameters stored inthe photographic parameters storing section 632 and related to theimages.

The image processing determining section 674 defines the allowable rangefor processing the image to be output which is stored in the imagestoring section 644 based on the data of the change in parameters storedin the photographic parameters storing section 632.

The image processing determining section 674 defines the allowable rangefor trimming similarly to the image processing determining section 634.The image processing plan storing section 676 stores the data of theallowable range for image processing defined by the image processingdetermining section 674 as relating to the image stored in the imagestoring section 644. The image processing plan storing section 676 mayreceive the data of the allowable range for image processing which isstored in the image processing plan storing section 636 and store it.

The image processing plan presenting section 680 displays the allowablerange of the image processing defined by the image processingdetermining section 674 to the user 180. The image processing planpresenting section 680 displays the data of the allowable range of imageprocessing stored in the image processing plan storing section 676. Forexample, the image processing plan presenting section 680 displays theallowable range of trimming defined by the image processing determiningsection 674 to the user 180. Especially, the image processing planpresenting section 680 displays and shows the allowable range oftrimming to the user 180 by framing the area to be trimmed on the imageto indicate the allowable range defined by the image processingdetermining section 674.

The image processing section 678 processes the image captured by theimage capturing section 602 in the allowable range defined by the imageprocessing determining section 674. The image processing section 678processes the image stored in the image storing section 644 in theallowable range defined by the image processing determining section 674.The output section 656 outputs the image processed by the imageprocessing section 678.

The image storing section 604 and image storing section 644 may be ahard disc, a semiconductor memory device, a CD-ROM, or other storagemedia, or a volatile memory which temporarily stores the image read fromanother storage media or CCD. The photographic parameters storingsection 632 may store the photographic parameters as the tag data of theimage stored in the image storing section 604. The image processing planstoring section 636 may store the data how to process the image as thetag data of the image stored in the image storing section 604. Thephotographic parameters storing section 672 may store the parameters asthe tag data of the image stored in the image storing section 644, andthe image processing plan storing section 676 may store the data how toprocess the image as the tag data of the image stored in the imagestoring section 644.

As described above, the image output system 690 defines the allowablerange for image processing when the image captured by the imagecapturing section 602 is output based on the changes in photographicparameters obtained by the photographic parameters acquiring section630. The image output system 690 can prevent from processing the imagein the manner which the user 180 doesn't intend to be output. The imageoutput system 690 can control to avoid trimming one person's image outof a group photo captured by the user 180 with a wide angle for thepurpose of taking the group photo.

FIG. 7 is a flow chart when the output device 640 processes the image byorder of the user 180. The output device 640 displays the allowablerange for trimming stored in the image processing plan storing section676 (S702). The output device 640 accepts the instruction teaching thetrimming range input of the user 180 The output device 640 evaluateswhether the instructed range falls within the allowable range (S706). Atthe stage of S706, if the instructed range falls within the allowablerange the image processing section 678 trims the image within theinstructed range to output. The output section 656 outputs the imagetrimmed by the image processing section 678 to be arranged in such as analbum.

If the instructed range doesn't fall within the allowable range, theoutput device 640 displays the error message alerting that theinstructed range isn't allowed and the process returns to the stage ofS702. The output device 640 outputs the error message at the stage ofS720 and may ask the user 180 if the image is trimmed as instructed andproceed the process to the stage of S708 if the instruction of trimmingin the instructed range is input by the user.

FIG. 8 is a part of a table including the parameters for capturing theimage and the corresponding allowable ranges which are used by the imageprocessing determining section 674. The image processing determiningsection 674 stores the data that the image captured with the field angle.alpha.1 and the change in field angle .alpha.2 is allowed to be trimmedso that the trimmed image is no less than .alpha.3% of the originalimage. In such case, the image processing plan presenting section 680displays the frame within which the image is trimmed and has the area of.alpha.3% of the original image. The image processing determiningsection 674 may store the length data indicating the allowable widthand/or height of the trimmed image to teach the allowable range. Thiscan prevent the image captured with a wide angle by the user fromunintendedly trimming in smaller range.

For another parameter except for captured area, the image processingdetermining section 674 also stores the data that if the image capturedwith the aperture value .beta.1 and the change in aperture .beta.2 isallowed to be compensated with the compensation value of .beta.3% orless to increase the brightness. The image processing plan presentingsection 680 can display the upper limit of the compensation near themenu list including the brightness compensation of the image processingsoftware, or disturb compensating operation by the user 180 not to inputthe compensation value over the upper point of the compensation value.This can prevent the output device 640 from compensating the imagecaptured with a big aperture by the user 180 to unintendedly increasethe brightness.

The image processing determining section 634 may have the tableincluding the parameters and the corresponding allowable rangessimilarly to the image processing determining section 674. The imageprocessing determining section 634 can also define the allowable rangefor image processing in the same way described about the imageprocessing determining section 674.

As described above, the image captured with a wide angle, for example,to take a group photo can prevent from being trimmed more largely thanintended. The image output system 690 can avoid to unintendedly trimmingthe image in large to make the output image obscure. The image outputsystem 690 can easily display the allowable range which reflects theintension on capturing the image to the user 180.

FIG. 9 is a diagram showing a configuration of hardware components of acomputer 1500 relating to the image capturing apparatus 100, the outputdevice 140, the image capturing apparatus 600 and the output device 640.The computer 1500 includes; a CPU 1505 a RAM 1520, a graphic controller1575, each of which is connected mutually with a host controller 1582,and a display device 1580, each of which is placed around the CPU; aninput/output section comprising a communication interface 1530, a harddisc drive 1540, and a CD-ROM drive 1560, both of which are connected tothe host controller 1582 via the input/output controller 1584; and alegacy input/output section comprising a ROM 1510, a flexible disc drive1550, and an input/output chip 1570, all of which are connected to theinput/output controller 1584.

The host controller 1582 connects the RAM 1520, the CPU 1505 making theRAM 1520 access at a high transfer rate, and the graphic controller1575. The CPU 1505 controls each component in accordance with theprogram stored in the ROM 1510 and the RAM 1520. The graphic controller1575 obtains the image created in the frame buffer made in the RAM by,for example, the CPU 1505 and displays the image on the display device1580. Alternately, the graphic controller 1575 may include a framebuffer to store the image created by, for example, the CPU 1505.

The input/output controller 1584 connects the host controller 1582, thehard disc drive 1540 which operates relatively fast, the communicationinterface 1530, and the CD-ROM drive 1560. The hard disc drive 1540stores the program and data used for the CPU 1505 in the computer 1500.The communication interface 1530 communicates with and provides theprogram and data through the network to the image capturing apparatus100 and the output device 140. The CD-ROM drive 1560 reads out theprogram and data from the CD-ROM 1595, and provides them to the harddisc drive 1540 and the communication interface 1530 via the RAM.

The input/output controller 1584 connects the ROM 1510, the flexibledisc drive 1550, and the input/output chip 1570, each of which operatesrelatively slowly. The ROM 1510 stores the boot program used when thecomputer 1500 boots up, and the program depending on the hardwarecomponents of the computer 1500. The flexible disc drive 1550 reads outthe program or the data from the flexible disc 1590, and provides it tothe hard disc drive 1540 and the communication interface 1530 via theRAM 1520. The input/output chip 1570 connects the flexible disc drive1550 and various input/output devices via such as a parallel port, aserial port, a keyboard port, or a mouse port.

The program provided to the communication interface 1530 via the RAM isstored in the flexible disc 1590, the CD-ROM 1595, IC card, or otherstorage media to be provided by users. The program is read out from thestorage media, provided to the communication interface 1530 via the RAM1520, and sent to the image capturing apparatus 100 or the output device140 via the network. The program sent to the image capturing apparatus100 and the output device 140 is installed in the image capturingapparatus 100 or the output device 140 to be implemented.

The program installed and implemented in the image capturing apparatus100 runs to function the image capturing section image capturing section202, the image storing section 204, the image capturing time measuringsection 206, the image capturing time storing section 208, the rankingcalculating section 210, the ranking data storing section 212, theoperation controlling section 222, the composition change amountdetecting section 224, the auxiliary image capturing section 226, thecriteria storing section 228, the identical area extracting section 230,the object extracting section 232, the Brightness histogram detectingsection 234, the color histogram detecting section 236, and the textureanalysis section 238, all of which are included in the image capturingapparatus 100 and described with FIGS. 1-3. The program installed andimplemented in the output device 140 runs to function the image storingsection 244, the image capturing time storing section 248, the rankingcalculating section 250, the output controlling section 254, and theoutput section 256, all of which are included in the output device 140and described with FIGS. 1 and 2. The program installed and implementedin the image capturing apparatus 600 runs to function the imagecapturing section 602, the image storing section 604, the photographicparameters acquiring section 630, the photographic parameters storingsection 632, the image processing determining section 634, and the imageprocessing plan storing section 636, all of which are included in theimage capturing apparatus 600 and described with FIGS. 1 and 6-8. Theprogram installed and implemented in the output device 640 runs tofunction the image storing section 644, the photographic parametersstoring section 672, the image processing determining section 674, theimage processing plan storing section 676, the image processing section678, the image processing plan presenting section 680, and the outputsection 656, all of which are included in the output device 640 anddescribed with FIGS. 1 and 6-8.

The programs described above may be stored in the externally connectedstorage media. Such storage media are, for example, DVDs, phase chargerewritable discs (PD), or other optical storage media, MDs, or othermagneto-optical disks, tape media, IC cards, or other semiconductormemories. The program may also be stored in such a hard disc or a RAMincorporated in a server system connecting a special communicationnetwork or the internet to be provided the computer 1500 via suchnetwork.

The present invention is described above with the embodiments. The scopeof the present invention, however, cannot be limited within theembodiments described above. The above embodiments can be modified orimproved variously. Apparently from the scope of what is claimed, suchmodified or improved embodiments can be included in the scope of thepresent invention.

1. An image output system, comprising: an image capturing section whichcaptures an image; a photographic parameters acquiring section whichacquires the change over time in photographic parameters changed by theuser's operation while capturing the image by said image capturingsection as relating to the image captured by said image capturingsection; an image processing determining section which defines theallowable range of processing the image captured by said image capturingsection to be output based on the change over time in photographicparameters acquired by said photographic parameters acquiring section;and an image processing plan presenting section which displays theallowable range of image processing defined by said image processingdetermining section to the user.
 2. The image output system according toclaim 1 which further includes: an image processing section whichprovides the image captured by said image capturing section with theimage processing operation within the range allowed by said imageprocessing controlling section; and an output section which outputs theimage processed by said image processing section.
 3. The image outputsystem according to claim 1, wherein said photographic parametersacquiring section obtains the change in photographic parameters changedby the user after the image capturing section is ready to capture theimage of the object and until it finishes capturing it.
 4. The imageoutput system according to claim 1, wherein said photographic parametersacquiring section obtains the filed angle and the amount of change infiled angle, which are resulted from the user's operation until saidimage capturing section captures the image as relating to the imagecaptured by said image capturing section, wherein said image processingdetermining section defines the allowable range of trimming when theimage captured by the image capturing section is trimmed and outputbased on the filed angle and the amount of change in field angleacquired by said photographic parameters acquiring section, and whereinsaid image processing plan presenting section displays the allowabletrimming range defined by said image processing determining section tothe user.
 5. The image output system according to claim 1, furthercomprising an output section which displays, when a range of processingthe image inputted by the user does not fall within the definedallowable range of processing the image, an error message alerting thatthe inputted range is not allowed.
 6. An image output method,comprising: an image capturing procedure in which an image is captured;a photographic parameters acquiring procedure in which the change overtime in photographic parameters changed by the user's operation untilthe image is captured are acquired as relating to the image captured insaid image capturing procedure; and an image processing determiningprocedure in which the allowable range of processing the image capturedin said image capturing procedure to be output is defined based on thechange over time in photographic parameters acquired in saidphotographic parameters acquiring procedure, and the defined allowablerange of image processing is displayed to the user.
 7. The image outputmethod according to claim 6, further comprising displaying, when a rangeof processing the image inputted by the user does not fall within thedefined allowable range of processing the image, an error messagealerting that the inputted range is not allowed.
 8. An image operatingapparatus, comprising: a photographic parameters acquiring section whichacquires the change over time in photographic parameters changed by auser's operation; and an image processing determining section whichdefines the allowable range of processing an image to be output based onthe change over time in the photographic parameters.
 9. The imageoperating apparatus according to claim 8, further comprising: an imagecapturing section which captures an image, wherein the photographicparameters acquiring section acquires the change in photographicparameters changed by the user's operation while capturing the image bysaid image capturing section as relating to the image captured by saidimage capturing section, wherein the image processing determiningsection defines the allowable range of processing the image captured bysaid image capturing section to be output based on the change inphotographic parameters acquired by said photographic parametersacquiring section, and wherein the image operating apparatus furthercomprises an image processing plan storing section which stores theallowable range of image processing defined by said image processingdetermining section as relating to the image captured by said imagecapturing section.
 10. The image operating apparatus according to claim8, further comprising: an image storing section which stores an imagecaptured by an image capturing apparatus, wherein the photographicparameters acquiring section acquires the change in photographicparameters changed by the user's operation until said image capturingsection captures the image as relating to the image stored in said imagestoring section, wherein the image processing determining sectiondefines the allowable range of the image processing when the imagecaptured by the image capturing apparatus is output based on the changein photographic parameters stored in said photographic parametersstoring section, and wherein the image operating apparatus furthercomprises an image processing plan presenting section in which theallowable range of image processing defined by said image processingdetermining section is displayed to the user.
 11. The image operatingapparatus according to claim 8, further comprising an output sectionwhich displays, when a range of processing the image inputted by theuser does not fall within the defined allowable range of processing theimage, an error message alerting that the inputted range is not allowed.12. An image operating method, comprising: providing a processorconfigured to perform a photographic parameters operating procedure inwhich the change over time in photographic parameters changed by auser's operation; and an image processing determining procedure in whichthe allowable range of processing an image to be output is defined basedon the change over time in photographic parameters acquired in saidphotographic parameters operating procedure.
 13. The image operatingmethod according to claim 12, further comprising: an image capturingprocedure in which an image is captured, wherein the photographicparameters operating procedure comprises an photographic parametersacquiring procedure in which the change in photographic parameterschanged by the user's operation while capturing the image by said imagecapturing section is acquired as relating to the image captured by saidimage capturing procedure, wherein the image processing determiningprocedure causes the allowable range of the image processing to bedefined when the image captured by the image capturing section is outputbased on the change in photographic parameters acquired in saidphotographic parameters acquiring procedure, and wherein the imageoperating method further comprises an image processing plan storingprocedure in which the allowable range of image processing defined bysaid image processing determining section is stored as relating to theimage captured by said image capturing procedure.
 14. The imageoperating method according to claim 12, further comprising: an imagestoring procedure in which an image captured by an image capturingapparatus is stored, wherein the photographic parameters operatingprocedure comprises a photographic parameters storing procedure in whichthe change in photographic parameters changed by the user's operationuntil the image is captured by said image capturing apparatus asrelating to the image stored in said image storing procedure, whereinthe image processing determining procedure causes the allowable range ofprocessing the image stored in said image storing procedure when theimage stored in image storing procedure is output is defined based onthe change in photographic parameters stored in said photographicparameters storing procedure, and wherein the image operating methodfurther comprises an image processing plan displaying procedure in whichthe allowable range of image processing defined in said image processingdetermining procedure is displayed to the user.
 15. The image operatingmethod according to claim 12, further comprising displaying, when arange of processing the image inputted by the user does not fall withinthe defined allowable range of processing the image, an error messagealerting that the inputted range is not allowed.
 16. A non-transitorycomputer readable medium storing thereon a program for an imageoperating apparatus which operates an image which functions the imageoperating apparatus comprising: a photographic parameters acquiringsection which operates the change over time in photographic parameterschanged by a user's operation; and an image processing determiningsection which defines the allowable range of processing an image basedon the change over time in photographic parameters acquired by saidphotographic parameters acquiring section.
 17. The computer readablemedium according to claim 16, the image operating apparatus furthercomprising: an image capturing section which captures an image, whereinthe photographic parameters acquiring section acquires the change inphotographic parameters changed by the user's operation until said imagecapturing section captures the image as relating to the image capturedby said image capturing section, wherein the image processingdetermining section defines the allowable range of processing the imagecaptured by said image capturing section to be output based on thechange in photographic parameters acquired by said photographicparameters acquiring section, and wherein the image operating apparatusfurther comprises an image processing plan storing section which storesthe allowable range of image processing defined by said image processingdetermining section as relating to the image captured by said imagecapturing section.
 18. The computer readable medium according to claim16, the image operating apparatus further comprising: an image storingsection which stores an image captured by an image capturing apparatus,wherein the photographic parameters storing section stores the change inphotographic parameters changed by the user's operation until said imagecapturing section captures the image as relating to the image capturedby said image capturing apparatus, wherein the image processingdetermining section defines the allowable range of processing the imagestored in said image storing section to be output based on the change inphotographic parameters stored in said photographic parameters storingsection, and wherein the image operating apparatus further comprises animage processing plan presenting section which displays the allowablerange of image processing defined by said image processing determiningsection.
 19. The computer readable medium according to claim 16, theimage operating apparatus further comprising an output section whichdisplays, when a range of processing the image inputted by the user doesnot fall within the defined allowable range of processing the image, anerror message alerting that the inputted range is not allowed.